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Abstract 

In previous papers we have introduced a sufficient condition for uniform attractivity of the origin 
for a class of nonhnear time- varying systems which is stated in terms oi persistency of excitation (PE), 
a concept well known in the adaptive control and systems identification literature. The novelty of 
our condition, called uniform i5-PE, is that it is tailored for nonlinear functions of time and state 
and it allows us to prove uniform asymptotic stability. In this paper we present a new definition 
of U(5-PE which is conceptually similar to but technically different from its predecessors and give 
several useful characterizations. We make connections between this property and similar properties 
previously used in the literature. We also show when this condition is necessary and sufficient for 
uniform (global) asymptotic stability for a large class of nonlinear time-varying systems. Finally, we 
show the utility of our main results on some control applications regarding feedforward systems and 
systems with matching nonlinearities. 



1 Introduction 

In many interesting nonlinear control problems, the closed-loop control system can be modeled by 
the differential equation 

x = F{t,x) (1) 

where F{-,x) is not necessarily periodic. 

When convergence of the trajectories of to a given fixed point is required (notice that this includes 
many problems of trajectory tracking control if we think of x as the tracking error), perhaps the most 
appealing notion that includes such convergence is uniform asymptotic stability (UAS) because of its 
inherent robustness and its assertion that the convergence rate does not depend on the initial time in 
any significant way. Such properties are typically not guaranteed when using Barbalat's lemma, for 
example, which is often used in adaptive and nonlinear control to establish convergence. 

*This work is supported in part by a CNRS-NSF collaboration project and was partially done while the first two authors 
were visiting the CCEC at UCSB. It is also supported by the AFOSR under grant F49620-00- 1-0106 and the NSF under 
grants ECS-9988813 and INT-9910030. 
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Nevertheless, one can precisely characterize the property of UAS in many different ways. For 
instance, via so-called ICC estimates that is, using a bounding function over the norm of the solutions, 
which decreases uniformly with time and increases uniformly with the size of the initial states. Another 
common characterization is via the use of smooth positive definite Lyapunov functions with a negative 
definite total derivative. See for instance \V2\ llbj . While these characterizations are very useful as 
intermediate steps in proving other properties (as for instance robust stability of a perturbed system) 
in general, Lyapunov functions or ICC estimates are difficult to obtain. 

Other sufficient and necessary conditions for uniform asymptotic stability involve verifying certain 
integral criteria which are somehow in the spirit of Barbalat's lemma but allow to conclude uniform 
convergence. For instance, roughly speaking one can prove that if the norm of the solution x(-) of 
((T]l and the integral of this norm squared are bounded by an increasing function of the initial states, 
a(|3;(to)|), which is zero only at zero, then the solutions necessarily converge to zero. One may also 
formulate conditions using more generic functions (other than quadratic) of the norm of the solutions. 
Furthermore, such conditions may be stated in a fairly general manner to cover stability of sets (not 
necessarily compact) other than the origin. Such sufficient and necessary conditions have been presented 
recently in [321 for systems described by differential inclusions. See also the references therein. 

In order to meet the required conditions imposed on the integral equations mentioned above or on the 
derivatives of Lyapunov functions, other approaches use observability- type arguments and exciteness 
conditions. Roughly speaking one tries to identify a converging output and then verifies whether all 
the modes of the zero-dynamics (i.e., the dynamics which is left by zeroing the output) are sufficiently 
excited so that all converge to zero. For linear systems such methods have been under investigation, 
based on , starting probably with j6j and followed by numerous works including OHj • In the 
nonlinear case we find for instance ^ EZl . See also the interesting recent paper ^Hl which establishes 
sufficient conditions for uniform convergence in terms of a detectability notion and appealing to the 
technique of limiting equations^ . 

The advantage of methods using observability-type arguments and related exciteness conditions is 
that for a certain class of systems one may infer the stability and convergence properties simply by 
"looking" at the dynamics of the system. For instance, for linear systems 



it was shown in [2HI that it is necessary and sufficient for uniform asymptotic stability that P{t) be 
persistently exciting (PE), namely that there exist a > and 6 G M such that for all unitary vectors 



Equivalently, this system is uniformly (in to) completely (i.e. for all initial states) observable (see e.g. 
[2]) from the output y{t) := P{t)x{t) if and only if P(-) is PE. Notice that P{t) does not need to be full 
rank for any fixed t. 

That PE is a necessary condition for uniform asymptotic (exponential) stability for linear systems 
has been well-known for many years now. In the case of general nonlinear systems, this was established 
for a generalized notion of persistency of excitation by Artstein in 4, Theorem 6.2]. Relying on the 
notion of limiting equations it was proved in that for the system Q it is necessary for uniform 
convergence that for each 5 > there exist a > and 6 € M such that 



X = —P{t)x, 



P{t) = P{ty > 0, Vt > 



xeW' 





(2) 




(3) 



Roughly speaking, dynamic equations describing the limiting (as t oo) behaviour of the system. 
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Sufficiency was also shown under other conditions involving Lyapunov functions and making use of a 
theorem establishing that uniform asymptotic stability of is equivalent to asymptotic stability of all 
the limiting equations of (Q). 

In view of the importance that persistency of excitation and related observability conditions have 
been proved to have in establishing convergence of linear and nonlinear systems, PE has been at the 
basis of the formulation of sufficient conditions for uniform asymptotic stability in many contexts. For 
examples, see H Theorem 6.3] and the results in UH], 0, 121 IH ESI , and [H EZl . In the context 
of adaptive control of nonlinear parameterized systems, other notions of persistency of excitation for 
nonlinear systems have been introduced recently in jl9j . 

In |23| 13 7j we introduced a sufficient condition for uniform attractivity for a certain class of non- 
linear systems. In words, our condition is that a certain function (t, x) i-^ (f){t, x) evaluated along the 
trajectories of the system, be persistently exciting whenever the trajectories are bounded away from a 
(5- neighbourhood of the origin (cf. Def. [HJ. Loosely speaking, this property, called uniform ^-persistency 
of excitation (u(5-PE), ensures that the zero-dynamics of the system is sufficiently excited. 

In this paper, we present a new definition of U(5-PE which is stated in a form that does not involve 
the state trajectories (see Def. |1} and therefore it is much simpler to verify. As a matter of fact, it 
is also a reformulation of the condition Q and for the system we will show both necessity and 
sufficiency for uniform convergence without relying on limiting equations theory. The former follows 
simply using a Lipschitz condition and Gronwall's lemma. The proof of sufficiency relies on a recent 
version of Matrosov's theorem (see Theorem 5.5]) reported in |22I- We will also present some 
applications in control systems design, including systems with "matching nonlinearities" which appear in 
applications involving passivity-based control, Model Reference Adaptive Control (MRAC), closed-loop 
identification, feedforward systems, among others. These results, which generalize in certain directions 
other contributions in the literature, follow as corollaries of our main theorems based on the property 
of U(5-PE. 

The rest of the paper is organized as follows: in the next section we define our notation and give 
some preliminary definitions. In Section|31we present the definition of uniform 5-PE (u(^-PE) and related 
properties. In Section [4. II we give a short proof of necessity of U(^-PE. In Section r4.2l we present a result 
on sufficiency of u5-PE which covers Artstein's result. In Sectional we present several application of 
our main results for a class of systems which includes the closed loop system in MRAC, and closed loop 
identification of mechanical systems. We conclude with some remarks in Sectional 

2 Preliminaries 

Notation. For two constants A > 5 > we define H{5,A) := {x e M."' : S < \x\ < A}. We also 
will use B{r) := Tl{0,r). A continuous function p : M>o M>o is of class M if it is non decreasing. 
A continuous function 7 : M>o — M>o is of class /C (7 S /C), if it is strictly increasing and 7(0) = 0; 
7 € /Coo if in addition, 7(5) — > 00 as s ^ 00. A continuous function (3 : M>q x M>o M>o is of class 
)C£. if (3{-,t) € /C for each fixed t € M>o and f5{s,t) — > as t — > -|-oo for each s > 0. We denote by 
x{-,to,Xo), the solutions of the differential equation x = F{t,x) with initial conditions {to,Xo)- 

We recall that a function F(-, •) is locally Lipschitz in x uniformly in t if for each xq there exists L 
such that 

\F{t,x)-F{t,y)\<L\x-y\ 

for all X and y in a neighbourhood of xq and for all t G R. For a locally Lipschitz function F : R x M" M 
we define its total time derivative along the trajectories of i = F{t, x) as, V{t, x) := ^ + ^F{t, x) . 
In general, this quantity is defined almost everywhere. 
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We will consider general nonlinear time- varying systems of the form where F : M x — > M"' is 
such that solutions of exist over finite intervals. As it has been motivated e.g. in |37l I27j . for these 
systems the most desirable forms of stability are those which are uniform in the initial time: 

Definition 1 (Uniform global stability) The origin of the system is said to be uniformly globally 
stable (UGS) if there exists 7 G /Coo such that, for each {to.,Xo) G M x M" each solution x{-^to-,Xo) 
satisfies 

\x{t,to,Xo)\<-i{\Xo\) yt>to. (4) 

Definition 2 (Uniform global attractivity) The origin of the system is said to be uniformly globally 
attractive if for each r, o" > there exists T > such that 

\xo\ <r =^ \\x(t, to, Xo)\\ < cr V t > to + T . (5) 

Furthermore, we say that the (origin of the) system is uniformly globally asymptotically stable (UGAS) 
if it is UGS and uniformly globally attractive. 

We will also make use of the following. 

Definition 3 (Uniform exponential stability) The origin of the system is said to be uniformly (locally) 
exponentially stable (ULES) if there exist constants 71,72 and r > such that for all {to-,Xo) G M x 5^ 
and all corresponding solutions 

||x(t,to,Xo)|| <7ilko||e"^2(*~*°) Vt>to. (6) 

The system is uniformly globally exponentially stable (UGES) if there exist 71, 72 > such that 
® holds for all {to,Xo) G M x M". □ 



3 Uniform ^-persistency of excitation 



We present a new definition of "u(5-PE" , a property originally introduced in |23| I37j . The newly 
defined property is conceptually similar to each of the previous ones; however, it is technically different 
in the sense that: first, it is easier to verify since it is formulated as a property inherent to a nonlinear 
function instead of being directly related to the solutions of a differential equation. Second, the new 
property defined below is also necessary for uniform attractivity of the system which is seemingly 
not the case with the previous definitions. Yet, it is interesting to remark that, in general, neither U(5-PE 
as defined in |37] nor as defined below, implies the other. 

Let X G be partitioned as x := col[xi,X2] where xi G M"^ and X2 G M"^. Define the column 
vector function (/> : M x ^ M"* and the set Vi := (M"i\ {0}) x M™^. 

Definition 4 A function (/>(•,•) where t 1-^ (p{t,x) is locally integrable, is said to be uniformly 6- 
persistently exciting (u(5-PE) with respect to xi if for each x € T>i there exist 6 > 0, T > and 
/X > s.t. Vi G M, 

rt+T 

\z — x\ < 6 =^ / \(j){T, z)\ dr > . (7) 

n 

If (/>(•,•) is u5-PE with respect to the whole state x then we will simply say that "0 is U(5-PE". This 
notation will allow us to establish some results for nonlinear systems with state x by imposing, on a 
certain function, the condition of u5-PE w.r.t. only part of the state. 

For the sake of comparison we recall below the definition proposed in [SZj and an equivalent char- 
acterization of U(5-PE. The former is stated as a property of a pair of functions {4>, F) where F is the 
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vector field in and tlie matrix function : M x M" W^'^ is such that <j){- ,to,Xo)) is locally 
integrable for each solution x{-,to,Xo) of (^. The latter may be viewed as a trajectory- independent 
formulation of the former. 

Definition 5 |37j The pair ((/>, F) is called uniformly (5-persistently exciting (u5-PE) with respect to xi 
[along the trajectories of (^] if, for each r and 6 > there exist constants T{r,6) > and n{r,5) > 0, 
s.t. y{to,Xo) G M X B{r), all corresponding solutions satisfy 

min \xi (t)\ > 5 

T&[t,t+T] 

t+T 

<I){t, x{T,to, Xo))(j){T, x{T,to, Xo))^ dr > fll 

for all t>to. □ 

We emphasize that Definition El is cited here only for the sake of comparison. Throughout this paper, 
when we say that a function is u5-PE we mean in the sense of Definition 0] 

Even though in spirit the properties in both definitions are the same, as pointed out before, they 
are technically different. This is illustrated by the following example. 

Example 1 Consider the system 

X := hi = ["H =: /(t,x) (8) 
[X2J \_xi \ ^ ' ^ ' 

whose solutions with initial conditions to = and Xo = [1 0]^ take the form xi{t) = cost, X2(t) = sin(t). 
Consider also the function 



ip{t, x) := [sin(t) — cos(t)] 



X2 



Clearly, x) is locally integrable for each x £ M^. One can see also that this function satisfies Defini- 
tion|l]since |V'(t,x)| = (xf sint^ — 2xiX2 sin(t) cos(t) + X2 cos(t)^)^/^ but it does not satisfy Definition|Sl 
with the initial conditions above, since |V'(t, x(t))| = 0. On the other hand, the function tp{t,x) := X2 
satisfies the trajectories-dependent property of Definition 13 but it does not satisfy Definition |3 for any x 
such that Xl 7^ (in particular for x = [10]"''). However, it is U(5-PE in the sense of Def. I^with respect 

to X2. □ 



3.1 Characterizations of v^-PE 

We present now some useful properties which are equivalent to Definition^ Our first "character- 
ization" of U(5-PE is actually a relaxed property. It states that when dealing with the particular (but 
fairly wide) class of uniformly continuous functions, it is sufficient to verify the integral in ((Tj) only for 
each fixed x such that xi 7^ (i.e., for "large" states). 

Lemma i If x 1— > (j){t, x) is continuous uniformly in t then (/>(•, •) is U(^-PE with respect to xi if and only 
if 

(A) for each x € Pi there exist T > and /j, > such that, for all t € M, 

rt+T 

\cPiT,x)\dT>f, . (9) 

□ 
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The following Lemma helps us to see that both Definitions [S] and |1] state in words that "a function 
(pit, x) is u5-PE with respect to xi if t i— > (j){t, x) is PE in the usual sense^ whenever the states xi (or 
similarly, the trajectories xi{t)) are large". This is important since it is the central idea to keep in mind 
when establishing sufficiency results based on the U(5-PE property. This idea also establishes a relation 
with the original but also technically different definition given in 



Lemma 2 The function ■) is u5-PE w.r.t. xi if and only if 

(B) for each 5 > and A > 5 there exist T > and fi > such that, for all t G M, 

rt+T 

\xi\ e [6, A] , \x2\ e [0, A] =^ / |0(r,x)| dr > /x. (10) 

^' □ 

The last characterization is useful as a technical tool in the proof of convergence results as we will see 
in Section [4.21 

Lemma 3 The function (p{-, •) is U(5-PE w.r.t. xi if and only if 

(C) for each A > there exist 7a G (md 9^ : M>o M>o continuous strictly decreasing such that, 
for all t G M, 

{|xi|, |X2| G [0, A]\{xi = 0}} =^ \Hr,x)\dT>jA{\xi\). (11) 

□ 

Remark 1 We may summarize the above characterizations as follows. 

• The following are equivalent: (j) is u5-PE with respect to xi, statement IbI statement fO Also, 
each of these implies Statement ^ 

• For uniformly continuous functions, (/> , it is sufficient to check Statement ^ which on occasions 
may be easier to verify. Consequently, El lO will also hold. 

□ 



3.2 Properties and facts of u5-PE functions 



We present below some important properties which hold for functions which are U(5-PE in the sense 
of Definition |1J Similar properties are well known for only-time dependent functions (cf. e.g. j33j ) and 
some of which were proved to hold as well in for pairs (F, (p) which satisfy Definitional 

Let (f){t,x) G M™" be U(5-PE with respect to xi in the sense of Definition |1] and let ai : M>o - 
i = 1, . . . , 2 be continuous non decreasing functions. Assume that for all x G M" and almost all t G 



< ai{\xi\) 

d(p{t,x) 

< a2(|a:;i|). 



dt 



(12) 
(13) 



We start by pointing out the following useful observation. 



That is, as defined for functions which depend only on time: that the function A 



m < n is PE if there 



exist T > and jj. > such that for all unitary vectors z £ R" we have that /^'^^ A{s)^ A{s)z ds > fj. 
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Fact 1 (Power of a Vid-PE function) If the scalar function (p{t,x) is u5-PE with respect to xi, with 
parameters 6, T and /j, > then, for any p > 1 the function ^{t, x) := (f>{t, x)P is U(5-PE with respect to 
xi, with parameters Tp = T and fip := | + | = 1- 

Proof. This property follows straightforward using Cauchy- Schwartz inequality to see that for each 
p> 1 there exists q satisfying ^ + | = 1 and 

t+T / ft+T \ 1/P 



/ rt+T 

\(l){t,x)\dt<U^ \(t>{t,x)\Pdt] T^/'i 



hence, for each x € Pi and alH € M we have that 



<-t+T p 

\z-x\<6 ^ I \(j)it,x)\Pdt > ^ 



J'p/q ■ 

A 

It is also useful to remark that for functions linear in the state, U(5-PE is equivalent to the usual PE 
property (when restricting t to the set of non- negative reals). 

Fact 2 Consider the function (j){t,x) := ^(t)~^x where $ : M ^ j^nxm jg locally integrable. Then, (j){t,x) 
is u5-PE with respect to x if and only if there exist T and /i > such that 

j^^ $(r)$(T)T(ir > /i VtGM. (14) 

Proof . Sufficiency follows from Lemma |2I Necessity follows from the observation that the implication 
H10|) holds in particular for 5 = A = 1 and that in this case, we have that for all t E M and for all 
unitary vectors x G M", 

ft+T 

J x'^$(T)$(T)^xdr > /i. (15) 

This is well known^ to be equivalent to (|14|) (see e.g. (221). The sufficiency follows observing that under 
p4|l. the integral in (|15)) is lower-bounded by |xp which in particular, for each pair A > ^ > and 
for all x such that A > |x| > 5, is equal to fi6'^ =: us > 0. ■ 

Property 1 (Filtered u6-PE function) Consider the differential equation 

^f = -f4t,^f)<S>f + <Pit,z) (16) 

where (/>(t, z) is U(5-PE with respect to zi and assume that: 

1) is such that 

\f^{t,^f)\<as{\^f\), as^Af. (17) 

2) There exist 04, & M such that with (j)f{- ,tf^,(pf^,z) denoting the solution of ((TB|) . we have that 

4>f{t,tf^,cl)f^,z)\<a4{\ct>fJ)a5{\zi\) Vt > . (18) 

Then, defining X2 ■= col[t/„ , 0/„ , 22] and xi := zi, the function (j)f{t,x) := (j)f{t,tf^,(j)f^,z) is u5-PE 
with respect to xi. 

^Strictly speaking this fact is well known for t £ R>o but clearly, this implies that the same property follows for t £ R. 
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hence, dropping the arguments for notational simphcity, we get from and H17|) that 



u < |(/>/|a2(|3;i|) +a3(|</./|) \<))f\ 101 -(/)>. 



(19) 



Then, using (|12|) and (fT8]) we obtain that 

to < \(pf\ a2(|xi|) + 03(04(10/0 DasCkiD) 10/1 ai([xi|) - 0^0 
therefore, for each A > we have that for ah xi and 0/^ such that max{|0j^[ , \xi\} < A, the constant 

c := a2(A) + a3(a4(A)a5(A))ai(A) > 



Since is u5-PE with respect to zi = xi with parameters fi and T we can invoke Fact^to fower bound 
the last term on the right hand of 1)191) and, H12|). ()18|) to bound the terms on the left hand side. We 
obtain that for each A > 6 > 0, each xi and 0/^, such that 6 < \xi\ < A and |0j^| < A, 



We present in this section our main results. We will show that for a fairly general class of nonlinear 
time-varying systems the property of u5-PE is necessary and sufficient for uniform attractivity of the 
origin. In other words, we establish that for UGS systems u5-PE is necessary and sufficient for UGAS. 

4.1 Necessity 

The following result, contained in [IJ Theorem 6.2], gives conditions under which u5-PE of the 
right-hand side of a differential equation is necessary for uniform asymptotic stability. The technical 
conditions that we use permit a relatively straightforward proof, based on Gronwall's lemma, without 
recourse to the notion of limiting equations which are used in |^ Theorem 6.2]. 

Theorem 1 (UGAS =^ u5-PE) Assume that F{-, •) in (pQ) is Lipschitz in x uniformly in t. If (Q) is UGAS, 
then F(-, •) is U(5-PE with respect to x G M". □ 





where we have defined k := [Tj/Tj — 1 and [rj as the largest integer smaller than r. Thus, choosing 




4 U(5-PE IS NECESSARY AND SUFFICIENT FOR UGAS 
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Proof . The Lipschitz assumption on F{-,-) implies that for each M > such that max{[y[ ,\z\} < M 
there exists L > such that 

\F{t,y)-F{t,z)\<L\y-z\ (21) 
for all t G M. From the UGAS assumption on © it follows that 3f3 £ ICC s.t. y{to,Xo) gRxW 

\x{t,to,Xo)\<p{\xo\,t-to), yt>to. (22) 

Notice that without loss of generality, we may assume that (3{s, 0) > s for all s > 0. 

For the purposes of establishing a contradiction, assume that the statement of the theorem does not 
hold. More precisely, and using Lemma ^ assume there exists x* 7^ such that for each T and ^ > 0, 
there exist G M such that 

\F{t,x,)\dt < n. (23) 



Pick T such that /?(|x*|,T) < Let the Lipschitz assumption generate the constant L > for 

I I 

M := /3(|x=k|,0) and let /i := — ^^-^ . Let these values generate t*, and consider the solution of 

starting at (t*,x*). By definition of solution, 

x{t,U,x^) = x^ + F{T,x{T))dT \/t>U, (24) 



which also satisfies 



(25) 



\x{t,t^,,x^:) — x^\ < / L\x{t) — X^\dT + / \F{T,X^)\dT. 

Jt, Ju 
Now, setting t = + T we have from ()23() that 

rU+T 

|x(t* + T, t^., X*) — x*| < j L\x{t) — x^\dT + fjL (26) 



so using the Gronwall-Bellman inequality we obtain that 



|x(t* + T, t,,, X*) - x*| < /xe ~ ■ (^''') 



On the other hand, |x(t* + T, t^,,x*)| < /3(|x=k| , T) < hence 

^ !*^* I 



which contradicts (|27|) . 



.^.^ Sufficiency 



Our main results on sufficiency of U(5-PE for UGAS derive from the sufficient conditions for UGAS 
that we have recently established in In that work we have generalized Matrosov's theorem (see, for 
example, |391 Theorem 5.5]). In our generalization, we assume UGS, which is standard in Matrosov's 
theorem, but then we use an arbitrary finite number of auxiliary functions to establish uniform con- 
vergence. (Matrosov's theorem relies on one auxiliary function.) Accordingly, the following sufficient 
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conditions are expressed in terms of a finite number of auxiliary functions (Assumption |2) having a 
certain nested property (Assumption ^ and the property that when the bounds on the derivatives of 
these auxihary functions are ah zero, this imphes that part of the state and a certain function are 
zero (Assumption Q and, moreover, that the function is U(5-PE with respect to the rest of the state 
(Assumption 1^ . The last technical assumption (Assumption IHl) bounds the derivative of the rest of the 
state in terms of the part of the state and the function that are zero in Assumption |^ 

Theorem 2 Under Assumptions ^101 below, the origin of is UGAS. □ 
Assumption 1 The origin is UGS. 

Assumption 2 There exist integers j, m > and for each A > there exist 

• a number fi > 

• locally Lipschitz continuous functions 

: M X M" ^ M, i G {1,. . . ,j} 

• a (continuous) function (/> : M x M" — W^, 

• continuous functions 1^ : M" x M, 

such that, for almost all {t,x) e M x B{A), 

max{\Vi{t,x)\, \(p{t,x)\} < (28) 
Mt,x) < Y,{x,(Pit,x)). (29) 

Assumption 3 For each k S {1, • • • , j} we have that^ 

(A) :{ (z,V)G^(A)x^(/x) , y,(z,V^)=0 Vz€{l,...,fc-1} } 
implies 

(B) : {n(z,V)<0}. 

Assumption 4 We have that 

(A) : {{z,i;) eB{A)xB{fi) , y,(z, V') = Vi G {1, . . . , j} } 
implies 

(B) : {zi = 0,Vi=0}. 

Remark 2 In Assumption |31 there is no requirement that the size of zi matches the size of V'l • D 

Assumption 5 The first component of (j){t,x) i.e., is independent of xi, locally Lipschitz in X2 
uniformly in t, U(5-PE w.r.t. X2 and zero at the origin. 

Assumption 6 For all {t,x) G M x B{A), we have |F2(t,x)| < pj\{xi^4>i{t,x)) where /?a is continuous 
and zero at zero. 



*For the case fc = 1 one should read Assumption |3] as Yi{x,(f)(t,x)) < for all {z,^p) G B{A) x B{ii). 
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Proof of Theorem\^ This result follows from the main result in j22j by using the additional function 

/oo 
e'-^\Mr,x)\dT. (30) 



We claim that this function satisfies for almost all (t, x) E M x B{A), 

Vj+i{t,x) < \Mt,x)\+Ya{x2)+K{A)p{xi,Mt,x)) (31) 

where 

Ya{x2) :=max{-|x2| , -exp(-6'A(|x2|))7A(|2;2|)} 
and K{A) represents a Lipschitz constant for cpi on the set R x B{A). Then, the result follows defining 

Yj+^{x, (Pit, x)) := \Mt, x)\ + Yaix2) + K{A)p{xi,Mt, x)) ■ 

We now prove that ()31|) holds. Let the U(5-PE property of (f)i and Lemma El generate the functions 
7A and ^a- It is direct to see that for any x G B{A) \ {x2 = 0} we have that 

rt+eAi\x2\) 

Vj+i{t,x) < -exp(-0A(|x2|)) / \Mt,x)\dT 



< -exp(-0A(|x2|)) -TAdxal) < 0. (32) 
Secondly, the partial derivatives of Vj^i are given by 

= \Mt,x)\- -e(*--)|0i(r,x)|dr 



dt ' " Jt dt 

dVj+i ^ _ /■°°^(,„.) 9|(/>i(t,x)| ^ 

9X2 Jt 9X2 

The Lipschitz assumption on 0i implies that for each A there exists K{A) such that, 

9(t)i{t,x) 



9X2 



< K{A) a.e. 



Hence, we obtain that 

- \Mt,x)\ + V,+i{t,x) 



9t 

and for almost all {t,x) G M x B{A), 



< KiA). 



9X2 

It follows that for almost all {t,x) G M x B{A), 

yj+i{t,x) < \Mt,x)\ + Vj+i{t,x) + K{A)p{xi,Mt,x)) . 

So pij) follows using the bound from ()32p in the inequality above. It is worth pointing out that ^a(') 
in is not defined at X2 = (see statement C in Lemma OJ. This motivates the definition of Ya{x2) 
using the max of the two terms. ■ 

The following corollary covers |2 Theorem 6.3]. 
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Corollary 1 If the origin of is UGS and the fohowing assumptions hold then, the origin of is also 
UGAS. 

Assumption 7 For each A > there exist 

• a number /i > 

• a locally Lipschitz continuous function 
y : M X ^ M, 

• a continuous function 1" : x ^ R, 

such that, for almost all E M x B{/^), 

max{|y(t,x)| , \F{t,x)\] < n, (33) 
V{t,x) < Y{x,F{t,x)). (34) 

Assumption 8 We have that 

(A) :{ iz,i;)€B{A)xB{ji)} 
implies 

(B) : {Y{z,^)<0}. 

Assumption 9 We have that 

(A) : {{z,^)eB{A)xB{f,) , Y{z,i;)=0} 
implies 

(B) : = } . 

Assumption 10 {t,x) i— > F(t,x) is locally Lipschitz in x uniformly in t and u5-PE with respect to x. 

5 Applications in control systems 

5.1 Systems with matching nonlinearities 

We consider now a particular class of nonlinear systems with x := col[xi, X2], xi € M"^, X2 € M"^ 
which may be viewed as a generalization of the classical strictly positive real system well studied in 
the context of linear systems. Hence, the structure of systems we consider in this section is important 
because, when inputs and outputs are considered^, they naturally yield passive systems. Consequently, 
the type of results that we will present here may be used in the analysis of passivity-based (adaptive) 
control systems. This will be illustrated further below, with the application to adaptive control of robot 
manipulators. 

A typical example of systems with matching nonlinearities is what we may call of the "MRAC-type" 
where MRAC stands for Model Reference Adaptive Control. These systems appear as closed loop 

^E.g. in applications of mechanical systems these may be external generalized torques and generalized velocities re- 
spectively. 
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equations in MRAC of linear plants (cf. ^^)- In the purely nonlinear context, they have also been for 
instance, in [31 EH HSl E] • 

More precisely, we will consider systems of the form with 



F{t,x) 



'A{t,x) + B{t,xj 
C{t,x) +D{t,x) 



(35) 



for which it is assumed that all functions are zero at x = 0. Moreover, we will make the standing 
hypothesis that the system is UGS. 

The reason why we decompose F{t,x) in 4 terms is that we will impose different conditions on each 
of them. Roughly speaking, we will require that xi = A{t,x) is UGAS with respect to^ xi, A and C 
vanish at xi = 0, D and B vanish at X2 = and moreover that the remainder of B(t,x), i.e. when 
xi = 0, is U(5-PE. 

The hypothesis on UGS holds for a large class of systems, including systems with the following 
interesting structure: 

xi = A{t, xi)xi + G{t, x)x2 (36a) 
X, = -P-^G{t,xV (^^^^^y , P = P^>0 (36b) 



where xi G M"i, X2 € K"^ and W : M"^ x M>o M>o is a positive definite radially unbounded 
function such that 

dW(t,xi) , 

—^^A{t,xi)xi<0. (37) 

Indeed, it is sufficient to take V{t,x) := W{t,xi) + 0.5x2^Px2 to see that the system is UGS since 
V(t, x) < 0. Notice that for this inequality to hold it is instrumental that the nonlinearities in the 
X2-equation match with the second term in the xi-equation. This motivates the title of the subsection. 

It may be also apparent that the structure ()36() is roughly, a direct generalization of linear positive 
real systems and strictly positive real systems in the case when (|37|) holds with a bound of the form 
— q:(|xi|), with a G /C. To better see this, let us restrict W{t,xi) to be quadratic then, we can view 
p6|l as two passive systems interconnected through the nonlinearity G{t, x), i.e., the xi equation defines 
a passive map X2 ^ xi (output feedback passive''' if H37() holds with — q(|xi|), with a € K.) and the 
X2 equation is an integrator (hence passive) . See for a real- world example and |241 12] for further 
discussions. 

We address two cases: when D{t, X2) = and when D{t, X2) ^ 0. With reference to the observations 
above, if we regard X2 as an input, we restrict G{t, x) to depend only on xi, and regard X2 as an output, 
these two cases actually correspond to those of relative degrees 1 and respectively. This may be more 
clear if we restrict further our attention to linear time-varying systems and define: W{t,xi) := ^ |xip, 
z := xi, z = A{t)z + B{t)u with B{t) = G{t), u := X2, and output y := G{t)z + D{t)u with C{t) := 
p-^B{t) and D{t)u =: D{t,u). 

We also present some concrete examples in the following subsections: we first revisit some stabi- 
lization results for feedforward systems a la 25 and then, we see how our results apply to closed-loop 
identification (or adaptive control) of mechanical systems. 

We now present the main results of this section. To that end, let us define 

Bo{t,X2):=B{t,x)\^^^^ (38) 

®We recall that a system is stable with respect to part of the state if, roughly speaking, the classical Lyapunov stability 
properties hold for that part of the state. See |5U| for details. 
''See |44| for a precise definition 
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and notice that necessarily, Bo{-,0) = 0. 

We also introduce the following hypothesis which together with ()37() . roughly speaking, is related 
to the attractivity of the set {xi = 0} or in other words, to the inherent stability of xi = A{t, x) with 
respect to xi which, in particular implies that xi{t) — > as t — > oo. Notice also that in the case that A 
in is linear time- independent and under (j^TJ, the following assumption is equivalent to requiring 
that A is stable. 



Assumption 11 For the system defined by (|35|) Assumption [3 holds and for the function !"(•,•) in (|34j) 
we have that 

(A) : { (z, V') G ^(A) X , y(z, V') = 0} 
implies 

(B) : {xi = } . 

The next hypothesis imposes a regularity condition on ■) and that A and C vanish when xi = 0. 
Within the framework of linear adaptive control systems, we may say that the first part is a general- 
ization of the global Lipschitz assumption on the regressor function. See |SZI for further discussions. 

Assumption 12 The functions A, B and C are locally Lipschitz in x uniformly in t. Moreover, for each 
A > there exist 6jv/ > and continuous nondecreasing functions pi : M>o — > M>o such that 
p.(0) = and for almost alH G M and x G M" 

max ||i?o(t, 3:2)1 , 

and for all (t,x) G M x M", |x2| < A, 

\B{t,x)-B,{t,X2)\<P2{\xi\) (40) 
max {Kt,x)|, |C(t,x)|}</53(ki|) (41) 

|a;2|<A 

The following theorem generalizes related results in the previously cited papers, including PHIT^OT] . 
See the last reference for a detailed but non exhaustive literature review. 

Theorem 3 Consider the system ^ , under Assumptions Q [71 |H1 ^2 and ^1 Suppose also that 

(Assumption 13) there exists a continuous non decreasing function p4 : M>o — >■ M>o such that p4{0) = 0, 

\D{t,x)\<pii\x2\) (42) 
and Statement [O holds with 9^ and 7a such that for all X2 7^ 

e-'^^\-'^'>jA{\x2\)>Spi{A)p^{\x2\). (43) 



dBo 
dt 



dBo 
dxo 



< Pl{\x2\ 



(39) 



Then, the origin is UGAS. □ 

Remark 3 Notice that for the common case when D = 0, Assumption reduces to requiring that 
Bo{-, ■) is U(5-PE with respect to X2. Also, in this case the necessity of the latter follows directly from 
Theorem n by observing that U(5-PE of F(-, •) as defined in implies by virtue of (|lT|l . that Bo{-, •) 
is u5-PE with respect to X2. □ 
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Proof of Theorem\^ We appeal to Theorem |2 Assumption ^ is our standing hypothesis. To verify 
the rest of the assumptions of Theorem |21 we introduce Vi{t,x) := V{t,x) where V{t,x) comes from 
Assumption Q and the locahy Lipschitz (due to Assumption I12p function 

/oo 
e(*"") |5o(r,X2)|^(ir (44) 

hence, j = m = 2 in Assumption |2J We also introduce 



(j)it,x) :-- 



X2 

F{t,x) 



(45) 



With these definitions, it is clear that (|28() holds since all the functions are locally Lipschitz in x 
uniformly in t and Vi{t,0) = (/'(t,0) = 0. To see that H29() also holds, we observe first that it is satisfied 
for Vi{t,x) in view of (jSU hence, we only need to check that there exists a continuous function Y2{-, •) 
satisfying the required conditions. To that end, we evaluate the total time derivative of V2{t,x) along 
the solutions of to obtain 

V2{t,x) = -xj (^^ + ^[C{t,x) + D{t,x)]^ +V2{t,x) + xjBo{t,X2) 
-[A{t, x) + B{t, x) - Boit, X2)]^Boit, X2) 

~ ir "^^^^ ^^ilC^ ) iC{t,x) + D{t,x)] a.e. (46) 

Notice also that by the U(5-PE condition on Bo{-,-) and in view of Assumption 1121 we have that 

V2it,x) < |xi|pi(|x2|)-e-^^(l^^l)7A(|x2|). (47) 

Furthermore, using this and Assumption 1121 again, we can over-bound several terms on the right hand 
side of as follows. Define bM ■= Pi{^) and /)(r, s) := 6M[3r + (r + 3)p3(r) + rp4(s) + /92(^) ] then, 
for almost ah {t,x) G M x B{A), 

V2{t, x) < p{\xi\ , \X2\) - e-^^(l"2l)7A(|x2|) + 2bMP4{\x2\) =: Y2{x, cl){t, x)) . (48) 

Define Y2{x, (j)(t, x)) := max{— \x2\ , Y2{x,(l){t,x))}. In view of and since p{0,s) = we have that 
Y2{x,(j){t,x)) < max{— |x2| , —^e~^^^^^^^^'yAi\x2\)} < when xi = 0. Thus, Assumption IHl holds for 
k = 1 due to AssumptionlSl (we recall that here, Yi = Y) and for k = 2, because Y2{x, (p{t, x)) < when 
xi = 0. 

Assumption holds due to the following. Let Yi{x,(p{t,x)) = Y2{x, (l){t, x)) = 0. Then, by Assump- 
tion^Jwe have that xi = while by definition, Y2{x,4>{t,x)) = implies that X2 = 0. 

Assumption [51 trivially holds and Assumption [HI holds with pa{xi,X2) ■= P4{\x2\) + /Osd^ij). ■ 

In support to the discussion at the beginning of the section it is worth remarking that Assumptions 
m [7| IHl and 111! hold under the following more restrictive but commonly satisfied hypothesis, at least for 
a large class of passive systems. Below, we present a concrete example concerning the adaptive tracking 
control of mechanical systems. 

Assumption I4 There exists a locally Lipschitz function F : M x M" — > M", class-/Coo functions ai,a2 
and a continuous, positive definite function 03 such that 

ai{\x\) <Vit,x) <a2i\x\) (49) 

and, almost everywhere, 

V{t,x)<-a3{xi) . (50) 



15 



It may be more clear from this assumption that part of the conditions in Theorem 13] are in the spirit 
of imposing that the system be asymptotically stable with respect to the xi-part of the state. Then, 
for the convergence of the X2-part of the trajectories we impose the U(5-PE exciteness condition. The 
following result which covers a class of systems similar to those covered by the main results in [241 
Appendix B.2], [331 1^ is ^ direct corollary of Theorem |3| 

Proposition 1 The system ^ , with D = and under Assumptions ^1 El is UGAS if and only if 
So(-, •) is u5-PE w.r.t. X2 . □ 

For clarity of exposition we present separately the following result, for systems when the 
"feedthrough" term D{t,x) is present. 

Proposition 2 Consider the system (^, (j35p under Assumptions IT21 1141 and 1131 Then, the origin is 

UGAS. □ 

We close the section with the counterparts of Propositions H and |21 which establish sufficient condi- 
tions for ULES. 

Proposition 3 Consider the system ()c{5() under Assumptions 1121 1131 and El and assume further that 
ai{s) := s^, z = 1 . . . 3, Pj{s) = pj s, j = 1 . . .A for small s and assume that the function Bo{t, X2) is 
u5-PE in the sense that Statement lUlholds with functions 7a('S) and 6'a(s) such that e~^^^^^j/^{s) > /x 
for small s and p > 3bMP4- Then, the origin is ULES. □ 

Proposition 4 Consider the system H35() with D{t,x) = and let Assumptions IT^ 1131 and 1141 hold 
with ai{s) := s^, i = 1 . . . 3, Pj{s) = pj s, j = 1 . . .3 for small s and assume that the function Bo{t, X2) 
is u5-PE. Then, the origin is ULES. □ 

Proof of Propositions\^ and\^ We provide a combined proof for both propositions, based on standard 
Lyapunov theory. 

Let A be generated by the U(5-PE assumption on Bo(t, X2). Let < i? < A be such that Pi{s) = piS, 
ai{s) := Ois'^ and e"^^'^'^^7A(s) > ps^ for all s < R. Let r := R^J^ then, from and ((^ we obtain 
that |xo| < r implies that \x{t)\ < R. In the sequel, we will restrict the initial conditions to Xq G B{r). 

Consider the Lyapunov function candidate V{t,x) := V{t,x) + eV2{t,x) where V2{t,x) is defined in 
H44|) and e is a small positive number to be chosen. Notice that V2{t,x) satisfies on R x B{R), 

-epi \x2\^ - epi \xi\ \x2\ < eV2{t,x) < epi \xi\ \x2\ - ep \x2\^ ■ (51) 

So we have that for sufficiently small e there exist a'^ > and a'2 > such that for all (t, x) € M x B{R), 

a[\x\^ <Vit,x) <a2\xf . (52) 

The total time derivative of V{t, x) on the points of existence and along the systems solutions yields, 
using (O and (gHl), 

V{t,x) < —{as — euji) |xi|^ + eur \xi\ \x2\ — ep |x2p + 2£bMPA \x2'^ a.e. (53) 

where i^r > 0. Next, using the condition imposed on p we obtain that 

V{t,x) < -{a^ - £UR)\xif' + euR\xi\\x2\ - £bMPA\x2\^ a.e. (54) 

In the case that Z? = we have that /94 = and completing squares in ()53() we obtain that for sufficiently 
small £ and sufficiently large 03 there exists c > such that V(t, x) < — c|xp. Otherwise, the latter 
holds from ()54() under similar arguments. ULES follows invoking standard Lyapunov theorems. 
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5.2 Dynamic bounded state feedback stabilization 



We briefly revisit the problem of stabilizing a nonlinear time-varying system by a dynamic state 
feedback control law u{t,^) under the constraint that, given Umax > the input \u(t,(,(t))\ < Umax for 
all t > to- In particular, we will revisit the generalized "Jurdevic & Quinn" approach proposed in 
Section II. C, item 2)] for feedforward systems. 

Consider the system 

i = f{t,C)+9{t,^,u)u (55) 

under the assumption that f{t, •) is locally Lipschitz uniformly in t and /(•, X2) is continuous, ^ = f{t, ^) 
is UGS and 5o(i, •= 5(^1 C)0) is such that for each A > there exists qm > such that 



max 

ICI<A 



\goit,0\, 



d9oit,0 



dt 



d9o{t,0 



< 9M 



a.e. 



(56) 



Under these conditions it is not difficult to show that there exist pf and pg € J\f such that |/(t,^)| < 
™d the bound above holds with /Og(|^|) for all ^. 



Proposition 5 Assume that there exists a Lyapunov function V : 
that 

dV dV ^, 

+ ^/(t,0<o 



^>o X 



for ^ = /(t, ^) such 



dt 



and there exist two class /C functions a4, 05 such that 

dV 



«4(|el) < 



<«5(|CI). 



The system (|55|) in closed loop with 



z 
u 



g{t,t Tanh(z))" 



dV_ 



Tanh(2:), Tanh(z) := col[ tanh(zi), . . . , tanh(z„)] 



(57) 



(58a) 
(58b) 



is UGAS only if for any unitary vector the function go{t,(,)~^C is u5-PE. Furthermore, the origin 
is UGAS if this function is u5-PE and Statement [O holds with 6*^ and 7a such that holds with 
pi(A) := gM and Pa = Pf- □ 

Remark 4 Certainly the result above holds for other (not necessarily smooth) saturation functions but 
tanh(-) is particularly convenient for the Lyapunov analysis that follows. □ 

That is, with respect to the result in ^5, Section II. C, item 2)] we contribute by addressing the problem 
for time- varying systems (see also [211) relax the "observability- type" condition [251 Assumption 
A2] by imposing a U(5-PE ccondition. As a matter of fact, notice that we can actually deal with the 
case when /(t, ^) = which is not included in the class of systems considered in |i25j . 

As an immediate corollary we also have the following. Consider the system 



i = F{t,^,u) 



(59) 



with F{t,^,,-) twice continuously differentiable and ^ = -F(t,^,0) is UGS. Then, we can rewrite this 
system in the form ()55() with 



/(t,0 := F{t,^,0) 
-1 dF 



9{t,C,u) 



r dF 



(60) 
(61) 
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Therefore, under the conditions above, the system H59() may be rendered UGAS by the bounded dynamic 
state feedback 

Proof of Proposition [31 To see that the system is UGS we evaluate the total time derivative of the 
function^ 

n 

W{t, e, z) = V{t, O + Yl Hcosh{zi)) (62) 

i=l 

to obtain 

W{t, ^, z) < -z'^ Tanh(z) < . (63) 



To show that the system is uniformly attractive for such initial conditions we simply apply Proposition 

dV 



121 with xi := z, X2 ■= A{t,x) := —z, B{t,x) := — g(i,^, Tanh(2;))^— — , C{t,x) := g{t,^,z)z and 



D{t,x) := f{t,£,). For this, we observe that under we have that 

\Bo{t,X2)r = ^^g{t,x2,0)g{t,X2,0)^ — 



> 



g{t, x2,oyc a4(la;2|) 



so it follows from Fact ^ and the monotonicity of a3(-) that Bo{t,X2) is U(5-PE if and only if 
g{t, X2, 0)^C = g{t, ^, 0)^ C is U(5-PE. The rest of the sufficient conditions of Proposition |2 hold observing 
that Yli=i lii(cosh(2;i)) is positive definite and radially unbounded and letting as{xi) := xj Tanh(a;i). 
■ 

The next proposition is a direct corollary for systems without drift, i.e., with f{t,(^) = 0. This class 
of systems has been extensively studied from many viewpoints since the celebrated paper |71. While 
not explicitly mentioned except for recent references of the authors, a common point of many of the 
approaches based on time-varying controls for driftless systems are based on the implicit assumption 
that the control input "excites" the system in some sense. We may cite the following "classical" papers 
[3S| V,V2\ I4()| I41j and j29| I14j where the PE is implicitly used to prove convergence. See also the more 
recent works [231 1211 00] . The first two references present what we have called U(5-PE controllers. The 
last presents a general result on a characterization of controllability for driftless systems and covers as 
particular case, the problem of stabilization of nonholonomic systems. 

Proposition 6 (Driftless systems) The system ()55() with f{t,^) = and the controller ()58() . is UGAS if 
and only if go{t,^)~^ is U(5-PE. □ 

The proof follows straightforward along the lines of the proof of Proposition [51 by taking V{t, — ^ \^\^- 

5.3 Closed loop identification of mechanical systems 

Lastly, we present a more particular example where the main results of this paper are useful. We will 
briefly address the problem of closed loop identification of mechanical systems, given by the Lagrangian 
equations: 

D{q)q + C{q,q)q + g{q)=u (64) 

where all matrices and vector functions are smooth in their arguments. 

We address the identification problem by considering the problem of tracking a desired (bounded 
and smooth) time-varying trajectory g*(t) under the assumption that positions and velocities {q,q) are 



^For other qualifying saturation functions we would use / sat(s)ds in 16211 
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available for measurement and the system parameters are unknown. This problem has been studied 
and partially solved (i.e., guaranteeing the convergence of tracking errors) by many different approaches 
within the robot control community. See e.g. j3t)j for a tutorial on adaptive control and |35j for 
a discussion from a passivity viewpoint. See also the recent tutorial on identification of mechanical 
systems, including a broad list of references. 

We remark that the contents of this section were originally reported in j2Uj and they extend the 
results of [46j where the authors proved non uniform parametric convergence under the same conditions 
that we will present here. Hence, among the numerous existing approaches to adaptive robot control 
we find that the best choice to highlight the utility of some of the results of this paper is the well known 
"Slotine and Li" algorithm |45j . 

To present this controller and a proof of UGAS of the origin (including the parametric errors) we 
recall that the model (|64j) is linear in the unknown parameters, i.e., there exists a smooth function 
5' : M" X M" ^ M™^" such that 

D{q)q + C{q, q)q + g{q) = ^{q, q, qY 6 . (65) 

For particular examples of robot manipulators and the explicit expressions of ^ see for instance \A7\ . 
The well known Slotine and Li [35] (passivity-based) adaptive control law is given by 

u = D{q)qr + C{q, q)qr + g{q) - KdS (66) 

where (•) denotes the estimate of the constant unknown lumped parameters, 9 € M"^, contained in (•), 
is positive definite, qr := q* — Xq, with X > 0, q := q—q^. and s := q—qr- Again, from the property that the 
model is linear in the unknown parameters one can show that there exists ^ : M" x M" x x M" — > 
such that, defining the parameter estimation error 9 := 9 — 9, the closed loop takes the form 

D{q)s + C{q,q)s + KdS = ^{q, q, qr, qrV 9 . (67) 

It is well known that the system above is uniformly globally asymptotically stable if ^^9 = 0. For 
instance, in 148. a Lyapunov function with a negative definite bound on the total time derivative is 
presented. 

Consider as in many previous papers starting probably with [3^1) that the estimated parameters 
vector 9{t) is updated according with the so called speed- gradient adaptive law, 

9 = --f^{q,q,qr,qr)s, 7>0. (68) 

Based on the theory for linear time-varying systems and classical results tailored for regressor functions 
which depend only on time, it was proved in [3Hj that the closed loop state trajectories tend to zero and, 
provided that ^'(<?*(t), g*(t), g*(t), g*(t)) is persistently exciting, so do the parameter estimation errors. 

Roughly speaking, this follows observing that '^{q{t),q{t),qr{t),qr{t)) — > 'if{q^{t), q*{t), q*{t), q*{t)) 
as i — oo and as it is well known now, (see e.g. ^SSJ a signal ^l^{t) = ^*{t) + e(t) where e ^ and tp* 
is PE, remains PE. 

The following proposition extends this result to UGAS of the origin of the closed loop system (that 
is, of (s, q, 9) = (0, 0, 0) ) with the same adaptive controller and under the same PE condition. Moreover, 
it also establishes that PE of ^'(g*(t), g'*(t), g'*(t), ^*(t)) in the sense of (fTH) is sufficient and necessary 
for uniform parameter convergence. 

Proposition 7 (Adaptive Slotine- and- Li controller \2U^ ) Consider the system ()64() in closed-loop with 
and the speed-gradient adaptive law (|68j) . Assume that the reference trajectory g*(t) and its first 
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two derivatives are bounded for all t. Then, the origin {6,q,s) = (0,0,0) is UGAS if and only if the 
function 

$(t) :=^{q,{t),q,{t),q,{t),q,{t)) 
is persistently exciting in the sense of H14() . □ 

The proof (which we do not provide here) relies on Proposition^ Roughly speaking. Assumption H12() 
holds from the smoothness and boundedness properties of the matrices D{q), C{q, q) and of the vector 
g{q) (see any book on robot control, e.g. |47| I43j). Assumption 1141 mav be shown to hold using a 
similar Lyapunov function as in The most interesting is the u5-PE condition. That this condition 
holds may be clear observing that in this case, the function B{t,x) := L)(t, xi2)~^^'(i, xn, ^12)^x2 
with D{t, X12) = D{q)^ xi := col[s,g], X2 := 9 and ^'(t, xn, X12) = '^{q,q,qr ■,%■)■ Therefore, since 
Bo{t,X2) = Z)(t, 0)~^^'(t, 0, 0) and D(t, 0) is positive definite and uniformly bounded for all the u5- 
PE condition on Bo{t,X2) is equivalent to a PE condition on ^'(t,0, 0) which actually corresponds to 
^iq*{t),q*{t),q^{t),q^{t)). See ^ for details. 



6 Conclusions 

In previous papers we introduced the concept of ^-persistency of excitation as a sufficient condition 
for uniform convergence of nonlinear systems. In this paper we presented a new mathematical definition 
which is not formulated with respect to trajectories. Moreover, we have proved for this new definition 
of (5-persistency of excitation that it is also necessary for uniform attractivity of certain nonlinear time- 
varying systems. Future research includes the use of this property in adaptive control of nonlinear ly 
parameterized systems and persistently excited state observers. 



A Proofs of Lemmas 

Proof of Lemma^ (^p) =^ uS-PF, : Let x* be an arbitrary element of Vi. Define T* := T(x*) < 00 
and fi* = n{x*) > so that @ holds. Using the uniform continuity of (f), let 6 > be such that, for all 
t G M, 

\z-x*\<6 =^ \^(t,z)-(P{t,x*)\<^. (69) 



2T* 



We then have for z such that — x*j < 5, 



t+T* rt+T* * 

\(t>{r,z)\dT > fi*-J^ \^(^r,z)-4>{T,x*)\dT > ^ . (70) 

u5-PE =^ : Obvious (and uniform continuity is not used). I 

Proof of Lemma\^ u5-PE =^ (|B|) : Let the u5-PE property of (p generate 6x, and Hx- Fix A > 5 > 
arbitrarily and define Vs^a ■= ^ I^" '■ & ['^j^]; I^2| S [O;^]}- Since Vs^a C Vi we have that 
holds for any x € Vs^a- Next, we note that the open sets B{x,6x) := € M" : — x| < 6x} cover 
Vs^A if we let x range over Vi that is, 

'DsA ^ U ^(^'^-)- 

Since Vs^ is compact from this cover we can extract a finite subcover of Vs^ (see e.g. ^1 ch. 3], [HD 
Lemma 5.1, p. 165]). In other words, there exists a finite number n, and a set M := {xi, X2, ■ ■ ■ , Xn} and 
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corresponding balls Bi{xi,5xi) such that the finite union of all these Bi^s contains T^s^a- The statement 
of the lemma follows defining 

T := maxTx u := min u^,. 

(iBj) =^ u(5-PE: Let ^ hold with A, 6 > 0, f, Jx. For any x G P35/2,a we have that (dHl) holds with 
T = T, fx = fl and 5 = (5/2. The result follows by considering 6 arbitrarily small and A arbitrarily large. 
■ 

Proof of Lemma\^ By Lemma |2 the function </)(■, •) is U(5-PE if and only if holds. We now prove 
that (IbJ) is equivalent to (0. 

That implies (|B1) follows straightforward by defining for each pair A > 5 > 0, T := 9^.(5) and 

We show now that statement (|B]) implies (jU]) . Fix A > otherwise arbitrarily. Let this A and each 
A > (5 > generate via Statement Ib} ixa{S) and Ta{6). Obviously /iA(-) and Ta(-) are positive. We 
define the functions fi^ '■ ^>o — *■ ^>o and Ta : M>o M>o as 

:= inf MA(r) Ta(5) := sup TA(r) . (71) 
mm{<5,A}<r<A mm{(5,A}<r<A 

Roughly, P-a{S) is the smallest over all /Ua(5)'s for which (jTU]) holds. Correspondingly, Ta is the largest 
of all applicable Ta's. Notice that /iA(') is nondecreasing while T'a(-) is nonincreasing and neither 
function is necessarily continuous. 

Also, from (|B|) we have that for each 5* > 0, 



and 



limsuprA((5) < oo (72) 

515* 



liminf^A('^) > . (73) 

515* 



This follows because if there exists 5* such that either (|72j) or (|73|) fail to hold then, invoking the 
definition of u5-PE with 5 := S* /2, we obtain that there exists /3 > and 9 > such that 



i-t+e 

G [572, A], |x2lG[0, A]} =^ \(l){T,x)\dT> (3. 

We conclude that on a neighborhood of 5* we can take /^a(<5) := min{/iA(5*), /?} > and Ta((5) := 
max{rA((5*), 9} so that neither ((ZSI) nor ((ZSJ wih fail. 

Now we turn the functions p-Ai') and Ta(-) into continuous functions 7a : K>o ^ M>o and ^a : 
M>o — > M>o. We define, for each s > 

7a(s) := inf {Aa(^) + |s-z|} (74) 
z>0 

f^c(^) := inf I nVr^ + (75) 

^>o (^max|l,rA(2;)| J 

and 

OAis) = -r^ . (76) 
Uc{s) 

If follows from (|72() . (|73|) and the definitions above that 7a and C/c, and in turn ^A) take values in M>o- 

Invoking standard arguments from nonsmooth analysis we obtain that 7a and Uc, and in turn 9a, are 
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continuous (see e.g. p", p. 44]). In addition, from ((7T|) we see that 7a(') is nondecreasing and 6{-) is 
nonincreasing. Moreover, 

7a(s) < Aa(s) (77) 

and 

U.is) < ^ (78) 

so that 

Ta(s) <max{l,TA(s)} < = ^a(s). (79) 

Consequently, in view of (|7T|) . (|77|) and (fTH]) . we have that (fTIH) holds with T = Oa{S) and /x = 7a('^)- Let 
7A € /C and 6'a : K>o — * I^>o be continuous strictly decreasing such that 7a(s) < 7a(s), ^a('5) < 0/^{s) 
for ah s > 0, 7a(0) = 7a(0) = and consider any xi G B{A)\{xi = 0}. Then, (Unj) holds with 
T = 0^{s) and fj, = 'jA.is), s = \xi\ and 6 arbitrarily small. Statement follows. ■ 
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